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SUMMARY 

This paper reports on a computer program, called GPS -I 
for General Problem Solving Program I. Construction and 
investigation of this program is part of a research effort 
by the authors to understand the information processes that 
underlie human intellectual, adaptive, and creative abilities. 
The approach is synthetic — to construct computer programs 
that can solve problems requiring intelligence and adaptation, 
and to discover which varieties of these programs can be 
matched to data on human problem solving. 

GPS -I grew out of an earlier program, the Logic Theorist, 
which discovers proofs to theorems in the sentential calculus . 
GPS-I is an attempt to fit the recorded behavior of college 
students trying to discover proofs. The purpose of this 
paper is not to relate the program to human behavior, but to 
describe its main characteristics and to assess its capaci- 
ties as a problem-solving mechanism. The paper will present 
enough theoretical discussion of problem-solving activity 
so that the program can be seen as an attempt to advance our 
basic knowledge of intellectual activity. The program will 
be assessed from this point of view, rather than whether it 
offers an economical solution to a significant class of 
problems . 

The major features of the program that are worthy of 
discussion are: 

1. The recursive nature of its problem-solving activity. 

2. The separation of problem content from problem - 
solving technique as a way of increasing the 
generality of the program. 

3. The two general problem-solving techniques that 
now constitute its repertoire: means -ends analysis, 
and planning. 

4. The memory and program organization used to 
mechanize the program (this will be noted only 
briefly, since there will be no space to describe 
the computer languages (IPL's) used to code GPS-I). 

Examples will be given of how GPS solves problems in 
the areas of elementary symbolic logic and elementary 
algebra . 



P-1584 
12-30-58 
-1- 



REPORT ON A GENERAL PROBLEM-SOLVING PROGRAM 

This paper deals with the theory of problem solving. It 
describes a program for a digital computer, called General 
Problem Solver I (GPS), which is part of an investigation into 
the extremely complex processes that are involved in intelli- 
gent, adaptive, and creative behavior. Our principal means of 
investigation is synthesis : programming large digital computers 
to exhibit intelligent behavior, studying the structure of 
these computer programs, and examining the problem-solving and 
other adaptive behaviors that the programs produce. 

A problem exists whenever a problem solver desires some 
outcome or state of affairs that he does not immediately know 
how to attain. Imperfect knowledge about how to proceed is at 
the core of the genuinely problematic. Of course, some initial 
information is always available . A genuine problem-solving 
process involves the repeated use of available information to 
initiate exploration, which discloses, in turn, more informa- 
tion until a way to attain the solution is finally discovered. 

Many kinds of information can aid in solving problems : 
information may suggest the order in which possible solutions 
should be examined; it may rule out a whole class of solutions 
previously thought possible; it may provide a cheap test to 
distinguish likely from unlikely possibilities; and so on. 
All these kinds of information are heuristics - things that 
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aid discovery. Heuristics seldom provide infallible guidance; 
they give practical knowledge, possessing only empirical 
validity. Often they "work," but the results are variable and 
success Is seldom guaranteed. 

The theory of problem solving is concerned with discover- 
ing and understanding systems of heuristics. What kinds are 
there? How do very general injunctions ("Draw a figure" or 
"Simplify") exert their effects? What heuristics do humans 
actually use? How are new heuristics discovered? And so on. 
GPS, the program described in this paper, contributes to the 
theory of problem solving by embodying two very general systems 
of heuristics - means -ends analysis and planning - within an 
organization that allows them to be applied to varying subject 
matters . 

GPS grew out of an earlier computer program, the Logic 
Theorist [5,8], which discovered proofs to theorems in the 
sentential calculus of Whitehead and Russell. It exhibited 
considerable problem-solving ability. Its heuristics were 
largely based on the introspections of its designers, and were 
closely tied to the subject matter of symbolic logic. 

The effectiveness of the Logic Theorist led to revised 
programs aimed at simulating in detail the problem-solving 
behavior of human subjects in the psychological laboratory. 
The human data were obtained by asking college sophomores to 
solve problems in symbolic logic, "thinking aloud" as much as 
possible while they worked. GPS is the program we constructed 
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to describe as closely as possible the behavior of the 
laboratory subjects as revealed in their oral comments and in 
the steps they wrote down in working the problems. How far it 
is successful in simulating the subjects' behavior - its use- 
fulness as a psychological theory of human thinking - will be 
reported elsewhere [7] . 

We shall first describe the over-all structure of OPS, and 
the kinds of problems it can tackle. Then we shall describe 
two important systems of heuristics it employs. The first is 
the heuristic of means -ends analysis, which we shall illustrate 
with the tasks of proving theorems in symbolic logic and 
proving simple trigonometric identities . The second is the 
heuristic of constructing general plans of solutions, which we 
shall illustrate, again, with symbolic logic. 

The Executive Program and the Task Environment 

GPS operates on problems that can be formulated in terms of 
objects and operators . An operator is something that can be 
applied to certain objects to produce different objects (as a 
saw applied to logs produces boards). The objects can be 
characterized by the features they possess, and by the 
differences that can be observed between pairs of objects . 
Operators may be restricted to apply to only certain kinds 
of objects; and there may be operators that are applied to 
several objects as inputs, producing one or more objects as 
output (as the operation of adding two numbers produces a 
third number, their sum) . 
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Various problems can be formulated in a task environment 
containing objects and operators : to find a way to transform 
a given object into another; to find an object possessing a 
given feature; to modify an object so that a given operator 
may be applied to it; and so on. In chess, for example, if we 
take chess positions as the objects and legal moves as the 
operators, then moves produce new positions (objects) from old. 
Not every move can be made in every position. The problem in 
chess is to get from a given object — the current position — 
to an object having a specified feature (a position in which 
the opponent's King is checkmated). 

The problem of proving theorems in a formal mathematical 
system is readily put In the same form. Here the objects are 
theorems, while the operators are the admissible rules of 
inference . To prove a theorem is to transform some initial 
objects — the axioms — into a specified object — the desired 
theorem. Similarly, in the problem of integrating functions 
in closed form, the objects are the mathematical expressions; 
the operators are the operations of algebra, together with 
formulas that define special functions like sine and cosine. 
Integration in closed form is an operation that does not 
apply directly to every object - if it did, there would be no 
problem. Integration involves transforming a given object into 
an equivalent object that is integrable, where equivalence is 
defined by the set of operations that can be applied. 
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Cons true ting a computer program can also be described as a 
problem in these same terms. Here, the objects are possible 
contents of the computer memory; the operators are computer 
instructions that alter the memory content. A program is a 
sequence of operators that transforms one state of memory into 
another; the programming problem is to find such a sequence 
when certain features of the initial and terminal states are 
specified. 

To operate generally within a task environment characterized 
by objects and operators, GPS needs several main components: 

1. A vocabulary, for talking about the task environ- 
ment, containing terms like: object, operator, 
difference, feature, Object #34, Operator #7. 

2. A vocabulary, dealing with the organization of 
the problem-solving processes, containing terms 
like: goal type, method, evaluation, Goal Type #2, 
Method #1, Goal #14. 

3. A set of programs defining the terms of the problem- 
solving vocabulary by terms in the vocabulary for 
describing the task environment. (We shall provide 
a number of examples presently.) 

4. A set of programs (correlative definitions) applying 
the terms of the task -environment vocabulary to a 
particular environment: symbolic logic, trigonometry, 
algebra, integral calculus. (These will also be 
illustrated in some detail.) 

Items 2 and 3 of the above list, together with the common 

nouns of Item 1 constitute GPS, properly speaking. Item 4 

and the proper nouns of Item 1 are required to give GPS the 

capacity to solve problems relating to a specified subject 

matter. Speaking broadly, the core of GPS consists of some 

general, but fairly powerful, problem-solving heuristics. To 




apply these heuristics to a particular problem domain, GPS 
must be augmented by the definitions and rules of mathematics 
or logic that describe that domain, and then must be given a 
problem or series of problems to solve. The justification for 
calling GPS "general" lies in this factorization of problem- 
solving heuristics from subject matter, and its ability to use 
the same heuristics to deal with different subjects. 

Let us look more closely at the problem-solving vocabulary 
and heuristics. To specify problems and subproblems, GPS has 
a discrete set of goal types . We shall introduce two of these 
initially: 



Finding a proof of a theorem (object b) from axioms (object 
a) is an example of a Type #1 goal; integrating (operator oj 
an expression (object a) is an example of a Type #2 goal. 

The executive organization of GPS shown in Figure 1, is very 
simple. With each goal type is associated a set of methods 
related to achieving goals of that type. When an attempt is 
made to achieve a goal, it is first evaluated to see whether 
it is worthwhile achieving and whether achievement seems likely. 
If so, one of the methods is selected and executed. This either 
leads to success or to a repetition of the loop. 



Goal Type #1: 



Find a way to transform object a into 
object b. (The objects, a and b", may 
be any objects defined in speclFying the 
task environment. The phrase "way to 
transform" implies "by applying a 
sequence of operators from the task 
environment ) 



Goal Type #2: 



Apply operator £ to object a (or to an 
object obtained from a by admissible 
transformations ) . 
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Goa I 
not 
achieved 



Command to 
achieve goal 









Evaluate goal 


Reject 








Accept 




Select method 
for this type goal 





to achieve 



Execute method 



Goal achieved 

Fig. I — Executive organization of GPS 
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The principal heuristics of OPS are imbedded in the 
methods. All the heuristics apply the following general 
principle : 

The principle o f subgoal reduction: Make progress by 

fnbTEltuting for the achievement of a goal the 

achievement of a set of easier goals. 

This is, indeed, only a heuristic principle, and it Is not 
as self-evident as it may appear. For example, none of the 
programs so far written for chess or checkers makes essential 
use of the principle [1,3*6]. 

The constant use of this principle makes GPS a highly 
recursive program, for the attempt to achieve one goal leads 
to other goals, and these, In turn, to still other goals. 
Thus, identical goal types and methods are used many times 
simultaneously at various levels in the goal structure In 
solving a single problem. Application of the principle also 
combines the goals and methods into organized systems of 
heuristics, rather than establishing each method as an 
independent heuristic. We shall provide examples of two such 
systems in this paper. 

Functional or Means -ends Analysis 

Means -ends analysis, one of the most frequently used 
problem-solving heuristics, is typified by the following kind 
of common sense argument : 

I want to take my son to nursery school. What's the 
difference between what I have and what I want? One 
of distance. What changes distance? My automobile. 
My automobile won't work. What's needed to make it 
work? A new battery. What has new batteries? An 
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auto repair shop. I want the repair shop to put 
in a new battery] but the shop doesn't know I 
need one. What is the difficulty? One of communica- 
tion. What allows communication? A telephone ... 
And so on. 

This kind of analysis - classifying things in terms of the 
functions they serve, and oscillating among ends, functions 
required, and means that perform them — forms the basic 
system of heuristic of GPS. More precisely, this means-ends 
systems of heuristic assumes the following: 

1. If an object is given that is not the desired one, 
differences will be detectable between the available 
object and the desired object. 

2. Operators affect some features of their operands 
and leave others unchanged. Hence operators can 
be characterized by the changes they produce and 
can be used to try to eliminate differences between 
the objects to which they are applied and desired 
objects . 

3. Some differences will prove more difficult to 
affect than others. It is profitable, therefore, 
to try to eliminate "difficult" differences, even 

at the cost of introducing new differences of lesser 
difficulty. This process can be repeated as long 
as progress is being made toward eliminating the 
more difficult differences. 

To incorporate this heuristic in GPS, we expand the 

vocabulary of goal types to include: 

Goal Type #3: Reduce the difference, d, between 

object a and object b by modifying a. 

The core of the system of functional analysis is given 

by three methods, one associated with each of the three goal 

types, as shown in Figure 2. Method #1, associated with 

Goal Type #1, consists in: (a) matching the objects a and b to 

find a difference, d, between them; (b) setting up the Type #3 



P-1584 

12-30-58 
-10- 



Goal type #|: Transform object a into object b 

Difference d 



Method #1: 



Match a to b 



Reduce d between 
a and b 



Identical 



Modified 
object, c_ 



Succeed 



Method 
succeeds 



1 



Fail 



Method 
fai Is 



Fail, try for 
new object 



Transform c into b 



Goal type #2: Apply operator q to object a 



Method #2: 


Transform a 
into c (q) , the 
input form of q 


Succeeds 


Produce the output 
c from P(q) the 

output form of q 










Fail 







c Method 
succeeds 



Method 

faiis 



Goal type #3: Reduce the difference, d, between object a and object b 



Method #3: 



Search for operator, q , 
relevant to reducing d. 



Me 



Apply q to g 



Fai 



hod 



.Fail 

Try for new 
operator 



Succeed, new 
object, c 



fails 



Method 
succeeds 



Fig. 2— Methods for means — ends analysis 
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subgoal of reducing d, which if successful produces a new 
transformed object c; (c) setting up the Type #1 subgoal of 
transforming c into b. If this last goal is achieved, the 
original Type #1 goal is achieved. The match in step (a) 
tests for the more important differences first. It also 
automatically makes substitutions for free variables. 

Method #2, for achieving a Type #2 goal, consists in: 
(a) determining if the operator can be applied by setting up 
a Type #1 goal for transforming a Into the C(pJ, the input 
form of £; (b) if successful the output object is produced 
from P(oJ, the output form of £. This method is appropriate 
where the operator is given by two forms, one describing the 
input, or conditions, and the other the output, or product. The 
examples given in this paper have operators of this kind. 
Variants of this method exist for an operator given by a 
program, defined iteratively, or defined recursively. 

Method #3, for achieving a Type #3 goal, consists in: 
(a) searching for an operator that is relevant to reducing the 
difference, d; (b) if one is found, setting up the Type #2 goal 
of applying the operator, which If successful produces the 
modified object. 

Application to Symbolic Logic. This system of heuristics 
already gives GPS some problem solving ability. We can apply 
GPS to a simple problem in symbolic logic. To do so we must 
provide correlative definitions for objects, operators, and 
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dlf f erences . These are summarized in Figure 3. We must also 
associate with each difference the operators that are relevant 
to modifying it. For logic this is accomplished explicitly by 
the table of connections in Figure 3, These connections are 
given to GPS, but it is not difficult to write a program that 
will permit GPS itself to infer the connections from the lists 
of operators and differences. (E.g., comparing the right side 
of Rl with its left side, we find they have the difference AP, 
for the symbols A and B appear in opposite orders on the two 
sides; hence, there is a connection between AP and Rl.) 
Finally, we provide criteria of progress, in terms of a list 
of the differences in order of difficulty. 

An illustrative logic problem and its solution are shown in 
Figure 4. The object, LI, is given, and GPS is required to 
derive the object, LO. The problem is stated to GPS in the 
form of a Type #1 goal: (Goal 1) Find a way to transform LI 
into LO. By Figure 2, this goal type calls for Method #1. 
Comparison of LI with LO shows that they have the difference, 
AP; for the "R" is on the left end of LI, but on the right end 
of LO. GPS now erects the Type #3 goal: (Goal 2) Reduce AP 
between LI and LO. Goal Type #3 calls for application of Method 
#3. Since the table of connections (Figure 3) shows that Rl is 
relevant to reducing AP, GPS erects the Type #2 goal: (Goal 3) 
Apply operator Rl to LI. The reader can follow the remaining 
steps that lead to the solution from Figure 4. 
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Objects . Expressions are built up recursively from variables, P, Q, R, 
. three biliary connectives, v, and the unary prefix, called 

tilde. Examples of objects: P, -Q, PvQ, (-R.P)3-Q. Double tildes cancel 
as in ordinary algebra: — Q - Q . 

Operators . There are twelve operators, given in the form C(q) -» P(oJ, where 
C(oJ is the input form , and P(aj is the output form . Thus anything of the 
form at the tail of an arrow can be transformed into the corresponding 
expression at the head of the arrow. A double arrow means the transformation 
works both ways. The abstracted operators , used in the planning method, are 
given in the right-hand column opposite the operator. 



Operators 



Abstract Operators 



Rl AvB -» BvA, A.B B.A 

R2 AoB -B3 -A 

R3 AvA <"> A, A. A <-■> A 

R4 Av(BvG) (AvB)vC, A.(B.C) «S-> (A.B).C 

R5 AvB -(-A.-B) 

R6 A=B «e-> -AvB 

R7 Av(B.C) (AvB). (AvC), A.(BvC) <r> (A.B)v(A.C) 

R6 A.B A, A.B -> B 

R9 A -> AvX (X is any expression.) 

RIO [A* B) -» A.B (Two expressions input.) 

Rll CA^>B, A] B (Two expressions input.) 

R12 [AaB, B^C] -> A^> C (Two expressions input.) 



Identity 
Identity 

(AA) <-> A 
A(BC) (AB)C 
Identity 
Identity 

A(BC) «-> (AB)(AC) 

(AB) A 
A -> (AX) 

[A, B] (AB) 
(JAB), A3 -> B 
C(AB), (BC)] -> (AC) 



Figure 3& . Symbolic logic task environment 
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Differencea. The differences apply to subexpressions as well as total 
expressions, and several differences may exist simultaneously for the same 
expressions. 



AV A variable appears in one expression that does not in the other. 

E.g., PvP differs by +V from PvQ, since it needs a Q; poR differs by 
-V from R, since it needs to lose the P. 

AN A variable occurs different numbers of times in the two expressions. 
E. g., P.Q differs from (P.Q)oQ by +N, since it needs another Q; 
PvP differs from P by -N, since it needs to reduce the number of P's. 

AT There is a difference in the "sign" of the two expressions; e.g., Q 
versus -Q, or -(PvR) versus PvR. 

AC There is a difference in binary connective; e.g., PoQ versus PvQ. 

AG There is a difference in grouping; e.g., Pv(QvR) versus (PvQ)vR. 

AP There is a position difference in the components of the two expressions; 
e. g., Po(QvR) versus (QvR)oP. 

Connections between Differences and Operators. A +, or x in a cell means 
that the operator in the column of the cell affects the difference in the row 
of the cell. + in the first row means +V, - means -V, etc. The stars show 
the differences and operators that remain after abstracting, and thus marks 
the reduced table of connections used in the abstract task environment for 
planning. 

#* 

HI R2 R3 R4 R5 R6 R7 R8 R9 RIO Rll R12 



*AV 
*AN 
AT 
AC 
*AG 
AP 



+ 
+ 



+ 
+ 



X 
X 



X 
X 



X 
X 



X 
X 



Criteria of progress . All differences in subexpressions are less important 
than differences in expressions. For a pair of expressions the differences 
are ranked: +V, -V, +N, -N, AT, AC, AG, AP, from most important to least. 
E. g., AT is more important in -(PvQ) versus P=>Q, but AC is more important 
in -PvQ versus P"3Q. 



Figure 3b. Symbolic logic task environment 
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Given: Ll - R.(-P=jQ) 
Obtain: LO » (QvP).R 

Goal 1: Transform Ll into LO. 

Match produces position difference (aP). 
Goal 2% Reduce aP between Ll and LO. 
First operator found is Rl. 
Goal 3: Apply Rl to Ll. 

Goal 4: Transform Ll into C(Rl). 

Match succeeds with A - R and B * -P=»Q . 
Produce new object: 

L2 - (-P=Q).R 

Goal 5: Transform L2 into LO. 

Match produces connective difference (aC) in left subexpression 
Goal 6: Reduce AC between left of L2 and left of LO. 
First operator found is R5. 
Goal 7: Apply R5 to left of L2. 

Goal 8: Transform left of L2 into C(R5) . 

Match produces connective difference (aC) in left subexpression. 
Goal 9: Reduce AC between left of L2 and C(R5). 

Goal rejected: difference is no easier than difference in 
Goal 6. 

Second operator found is R6. 
Goal 10: Apply R6 to left of L2. 

Goal 11; Transform left of L2 into C(R6). 
Match succeeds with A » -P and B « Q. 

Produce new object: 

L3 - (PvQ).R 

Goal 12: Transform L3 into LO. 

Match produces position difference (aP) in left subexpression. 
Goal 13: Reduce aP between left of L3 and left of LO. 
First operator found is Rl. 
Goal 14: Apply Rl to left of L3. 

Goal 15: Transform left of L3 into C(Rl). 

Match succeeds with A » P and B - Q. 
Produce new object; 

L4 - (QvP) ,R 

Goal 16: Transform L4 into LO. 

Match shows L4 is identical with LO, QED. 



Figure 4. Example of means-ends analysis in logic. 
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The resulting derivation may be summarized: 



Object 



Operator 



LI m R. (-P=>Q) 
L2 - (-PoQ) .R 
L3 - (P v Q) .R 
L4 = (Q v P) .R 



Apply Rl to LI 
Apply R6 to left side of L2 
Apply Rl to left side of L3 



Q. E. D. 



Lk is identical with LO 



GPS can solve problems a good deal more difficult than the 
simple one illustrated. To make full use of the twelve 
operators, an additional method is added to the Type #3 goal 
that searches the available objects for the additional input 
required in rules RIO, Rll, and R12. 

Application to Trigonometry, GPS is a general problem 
solver to the extent that its heuristics can be applied to 
varying subject matters, given the appropriate correlative 
definitions. Elementary algebra and calculus provide a 
subject matter distinct from logic, and Figure 5 shows the 
fragment of this task environment necessary for GPS to try to 
prove some simple trigonometric identities. The objects are now 
algebraic and trigonometric expressions; and the operators 
perform factorization, algebraic simplification, and trigono- 
metric transformation. The differences are the same as in 
logic, except for two omissions, which are related to the 
associative and commutative laws . In logic these must be 
performed explicitly, whereas in ordinary algebra a notation is 
used that makes these laws implicit and their operation 
automatic. The connections between differences and operators 
is not made via a simple table, as in logic, but requires a 
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. Qbjects. Ordinary algebraic expressions, including the trigonometric functions, 
The associative and commutative laws are implicit in the notation: the program 
can select freely which terms to use in an expression like (x + y + z). 

Operators . 

AO Combine ; Recursively defined to apply the following elementary identities 
from the innermost subexpressions to the main expression: 

A + (B+C) — > A + B + C, A(BC)— > ABC, 
A + 0 — > A, A + A — > 2A, A - A — > 0 
AO-* 0, Al— > A, AA — > A 2 , A B A C — > A B+C 



A°-» 1, » 0, A 1 -* A, (A B ) C -* A BC 



Al (A-B)(A+B) <-> A 2 -B 2 

A2 (A+B) 2 «-» A 2 + 2AB + B 2 

A3 A(B+C) «S-> AB + AC 

Tl tan x <-> l/cot x 
T2 (tan x)(cot x) <r-> 1 
T3 tan x «e-> sin x / cos x 

T4 cot x <— > cos x / sin x 

2 2 
T5 sin x + cos x 1 

Differences. Defined as in logic: aV , AN, AC, AT. AG and AP do not occur in 

algebra, since associativity and commutativity are built into t,he programs for 

handling expressions. The trigonometric functions are detected by AV and AN. 

Connections between Differences and Operators , A + , or x in a cell means that 
the operator in the column of the cell affects the difference in the row of the 
cell. A t means that the test defined at the bottom is applied. 



AV 
AC 
AN 
AT x 

Test t; accept if other functions in output form, already occur in expression. 

Criteria of progress. Defined as in logic, but with AC more important than AN or 
AP. 



AO 


Al 


A2 


A3 


Tl 


T2 


T3 


T4 


T5 










t 


t 


t 


t 


t 


x 


X 


X 


X 














X 


X 


X 


t 


t 


t 


t 


t 



Figure 5. Trigonometry task environment. 
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comparison of the object with the output form of the operator. 
The criteria of progress remain the same as for logic. 

GPS can now attempt to prove a trigonometric identity like: 

(tan x + cot x)sln x cos x = 1 
This is given as the problem of tranf orming the left side, 
which becomes LI, into the right side, LO. The process of 
solving the problem, which involves 33 goals and subgoals, is 
shown in Figure 6, which is to be interpreted in exactly the same 
way as Figure 4, with the help of Figures 2 and 5, except that 
explicit mention of the methods is suppressed. 

Planning as a Problem-solving Technique 

The second system of heuristic used by GPS is a form of 
planning that allows GPS to construct a proposed solution in 
general terms before working out the details. It acts as an 
antidote to the limitations of means -ends analysis in seeing 
only one step ahead. It also provides an example of the use 
of an auxiliary problem in a different task environment to aid 
in the solution of a problem.* Planning is incorporated in 
GPS by adding a new method, Method #4, to the repertoire of 

the Type #1 goal. 

This Planning Method (see Figure 7) consists in (a) 
abstracting by omitting certain details of the original objects 



♦See the work of H.Gelemter and N. Rochester on theorem proving 
programs for plane geometry [2], where the geometric diagram 
provides an example of a very powerful auxiliary problem space. 



Given: Ll - (tan x + cot x) sin x cos x 
Obtain: LO - 1 

Geal 1: Transform Ll into LO. 

Goal 2: Reduce -V between Ll and LO (tan). 

Goal 3: Apply AO (combine) to LO [ho change produced) . 
Goal 4: Apply Tl to Ll. 

Goal 5; Transform Ll into C(Tl) succeeds . 

L2 - C(l/cot x) + cot xjsin x cos x 

Goal 6: Transform L2 into LO. 

Goal 7 : Reduce -V between L2 and LO ( cot ) . 

Goal 8: Apply AO to L2 [no change produced] . 
Goal 9: Apply T4 to L2. 

Goal 10: Transform L2 into C(T4) [succeeds] . 

13 " C(l/(cos x/sin x)) + (cos x/sin x) "} sin x cos x 

Goal 11: Transform L3 into LO. 

Goal 12; Reduce -V between L3 and LO (cos). 
Goal 13: Apply AO to L3t 

L4 " C(sin x/cos x) + (cos x/sin x)] sin x cos x 

Goal 14: Transform L4 into LO. 

Goal 15: Reduce -V between L4 and LO (sin). 

Goal 16: Apply AO to L4 [no change produced] . 
Goal 17: Apply T5 to L4. 

Goal 18: Transform L4 into C(T5). 

Goal 19: Reduce AC between L4 and C(T5) (• to +). 
Goal 20: Apply AO to L4 C n0 change produced]. 
Goal 21: Apply Al to L4. 

Goal 22: Transform L4 into C(Al). 

Goal 23: Reduce AC between L4 and C(Al) [reject] . 
Goal 24: Apply A3 to L4. 

Goal 25: Transform L4 into C(A3) C succee< * s 3 • 

L5 ■ [sin x/cos x]sin x cos x + [cos x/sin x] sin x cos x 

Goal 26: Transform L5 into C(T5). 

Goal 27: Reduce AC between left of L5 and left of C(T5). 
Goal 28: Apply AO to left of L5: 

2 

L6 « sin x + [cos x/sin x ] sin x cos x 

Goal 29: Transform L6 into C(T5) . 

Goal 30: Reduce AC between right of L6 and right of C(T5). 
Goal 31: Apply AO to right of L6: 

L7 ■ sin^x + cos^x 

Goal 32: Transform L7 into C(T5) [succeeds] . 

L8 - 1 

Goal 33: Transform L8 into LO [identical], QED. 
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Figure 6. Example of means-ends analysis on trigonometry. 
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and operators, (b) forming the corresponding problem in the 
abstract task environment, (c) when the abstract problem has 
been solved, using its solution to provide a plan for solving 
the original problem, (d) translating the plan back into the 
original task environment and executing it. The power of the 
method rests on two facts. First, the entire machinery of GPS 
can be used to solve the abstract problem in its appropriate 
task environment; and, because of the suppression of detail, 
this is usually a simpler problem (having fewer steps) than 
the original one. Second, the subproblems that make up the 
plan are collectively simpler (each having few steps) than the 
original problem. Since the exploration required to solve a 
problem generally increases exponentially with the number of 
steps in the solution, replacement of a single large problem 
with several smaller problems, the sum of whose lengths is 
about equal to the length of the original problem, may reduce 
the problem difficulty by whole orders of magnitude. 

Figure 8 shows the Planning Method applied to a problem of 
symbolic logic. The particular abstraction scheme that is 
illustrated ignores differences among connectives and the 
order of symbols (AC and AP), replacing, for example, 
"(Ro-P) • (-R=>Q)" with "(PR) (OR)? The operators are similarly 
abstracted, so that " AvB->BvA" becomes " ( AB)->( AB)'» - i.e., the 
identity operator - and "A.B->A M becomes "(AB)-»A7 as shown in 
Figure 3. The abstracted problem, Transform Al into AO, has 
several solutions in the abstracted task environment. One of 
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Goai type #!: Transform object a into object b 



Method # 4: 




Method 
fa i Is 



Abstracted 
objects, a', b' 



Transform g into b' 
using abstract 
operators 



Sequence of 
abstract operators: 

q 1' » q 2' , ■ * • 



Fai 



Method 
fail s 



Fai I, try 
for new pian 



Specialize operators 



Sequence of 
operators : 



Fail, try for new 
special ization 



Apply sequence of 
operators to g 



Final object, c 



Fail, try for new 
final object 



Transform c into b 



Succeed 



Method 
succeeds 



Fig. 7 — PI anning method 
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Given: Ll - (R=> -P) .(-R=Q) 
Obtain: LO - -(-Q.P) 

Goal 1: Transform Ll into LO CMethod Ho.l fails j now Method No. 4 is tried] . 
Abstract Ll and LO: 

Al - (PR) (OR) 
AO - (PQ) 

Goal 2: Transform Al into AO (using abstracted operators) . 
Several plans are generated (details are omitted): 

Pi - R8, Rll, R12. 
P2 - R8, R8, R12. 
P3 - ... 

Goal 3 : Apply PI to Ll [fails , details are omittedj . 

Goal 4: Apply P2 to Ll. 
Goal 5: Apply R8 to Ll. 

Goal 6: Transform Ll into c(R8) C succeeds 3 • 

L2 - R3 -P 

Goal 7: Apply R8 to Ll. 

Goal 8: Transform Ll into C(R8) [succeeds] . 

L3 — R^Q 

Goal 9: Apply Rl2 to L2 and L3. 

Goal 10: Transform L2 and L3 into C(R12) [L2 fits B=»CJ. 
Goal 11: Reduce AP between L3 and C(R12) (A=»B with B-R) . 
Goal 12: Apply R2 to L3- 

Goal 13: Transform L3 into C(R2) [succeeds], 

L4 a -Q^>R 

Goal 14: Transform L2 and L4 into C(R12) [succeeds} . 

L5 - -Q=> -P 

Goal 15: Transform L5 into LO. 

Goal 16: Reduce AT between L5 and LO. 

Goal 17: Apply R2 to L5 [fails, details omitted]. 
Goal 18: Apply R5 to L5. 

Goal 19: Transform L5 into C(R5). 

Goal 20: Reduce AC between L5 and C(R5). 
Goal 21: Apply R5 to L5 [reject] . 
Goal 22: Apply R6 to L5 

Goal 23: Transform L5 into C(R6) [succeeds]. 

L6 - Qv-P 

Goal 24: Transform L6 into C(R5) [succeeds] . 
L7 - -(-Q.P) 
Goal 25: Transform L7 into LO [identical] , QED. 



Figure 8. Example of planning on logic. 
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these may be summarized: 



Object 



Operation 



Al = 
A2 - 
A3 = 



PR) (QR) 



Apply R8 to get left side of Al 
Apply R8 to get right side of Al 
Apply R12 to A2 and A3 



PR) 
QR) 
PQ) 



But 



PQ) is identical 
with AO 



Q. E. D. 



Transforming Al into AO is the abstract equivalent of the 
problem of transforming LI into LO. The former is solved by 
applying the abstracted operators corresponding to R8, R8, and 
R12 in sequence. Hence (Figure 8, Goal h) a plan for solving 
the original problem is to try to apply R8 to LI (obtaining a 
new object whose abstract equivalent is (PR)), applying R8 to 
the other side of LI (obtaining an object corresponding to 
(QR)), applying R12 to the objects thus obtained, and finally, 
transforming this new object (which should be an abstract 
equivalent of LO) into LO. Each of the first three parts 
of this plan constitutes a Type #2 goal in the original task 
environment - that is, it requires the application of a 
specified operator to a specified expression. These three 
Type #2 goals are Goals 5, 7, and 9, respectively, in Figure 8. 
The first two are achieved almost trivially, and the third 
requires only five subgoals . The result is the expression, 
L5, which is to be transformed to LO, as indicated by a 
Type #1 goal (Goal 15). Note that achieving the plan only 
Involves operators that become the identity operator upon 
abstraction. 
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Like the other heuristics, the planning heuristic offers 
no guarantees that it will always work. It may generate no 
plan, a single plan, or several. More serious, a plan may 
turn out to be Illusory — it may prove impossible to carry it 
out. The first plan generated in the illustrative problem, for 
example - R8, Rll, R12 - does not provide a basis for a valid 
derivation when it is translated back to the concrete task 
environment. The time wasted in fruitless efforts to execute 
invalid plans must be counted in evaluating the planning 
heuristic, but even when allowance is made for this cost, the 
heuristic remains a very powerful one. 
Conclusion 

We have now described the principal heuristics that are 
used by GPS, and have shown how these heuristics enable it to 
solve problems. Although limitations of space prevent full 
discussion, we would like to conclude by mentioning several 
aspects of GPS that have received inadequate treatment in 
this paper. 

1. GPS requires additional goals and methods, and we 
have investigated a number of these to varying degrees. 
For example, in many problems features of objects come to 
play a larger role than differences between objects - e.g., 
control of center in chess. A goal and methods similar 
to Type #3 are needed to handle features. Solving single 
equations in one variable also requires a new goal and 
new methods embodying such heuristics as operating on 
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both sides of an equation to isolate the variable. This 
goal is already needed in trigonometry to recognize that 
sin 4 x - cos^x is of the form y 2 - z 2 , so it can be factored. 
Already with its present repertoire OPS can handle algebraic 
simplification, and integration of relatively simple ex- 
pressions with the aid of a table of integrals. There 
is some hope, as the example introducing means -ends analysis 
indicates, that GPS may be capable of the common sense think- 
ing that gets most humans through the details of each day's 
living. 

2. GPS is given very little information about a task 
environment, and deals with the most general features of it. 
Beyond a point most of the heuristics of GPS will be devoted 
to discovering special systems of heuristics for particular 
subject matters. In trigonometry, for example, GPS needs to 

be able to learn such heuristics as "reduce everything to sines 
and cosines," and "follow a trigonometric step with an algebraic 
step." In fact it followed these roughly in the example given, 
but only in a cumbersome fashion. The one narrow piece of 
learning we have mentioned - associating differences with 
operators — is a start in this direction, 

3. Realizing programs like GPS on a computer is a major 
programming task. Much of our research effort has gone into 
the design of programming languages (information processing 
languages) that make the writing of such programs practicable. 
We must refer the reader to other publications for a description 
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of this work [4,9]. However, we would like to emphasize that 
our description of GPS in this paper ignores all information 
handling problems: how to keep track of the goals; how to 
associate with them the necessary information, and retrieve 
itj how to add methods to an already running system; and so on. 
These technical problems form a large part of the problem of 
creating intelligent programs. 

4. In this paper we have also underemphasized the role 

of the evaluation step - the opportunity to reject a goal before 
any effort is spent upon it. The methods are generative, 
producing possible solutions. They are only heuristic, and 
so will produce many more possibilities than can be explored. 
The evaluation applies additional heuristics to select the 
more profitable paths, and strongly affects the problem solving 
ability of GPS. The means -ends analysis is a general heuristic 
because progress can be evaluated in the same general terms 
as the methods. More specific evaluations will again require 
learning. 

5. Limitations of space have forced our examples to focus 
on the correct solution path. They do not convey properly the 
amount of selection, and trial and error. This is particularly 
unfortunate, since dramatically viewed, problem-solving is the 
battle of selection techniques against a space of possibilities 
that keeps expanding exponentially [5, 7j . 
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